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Abstract — We consider the multiple unicast problem with three 
source-terminal pairs over directed acyclic networks with unit- 
capacity edges. The three Si — U pairs wish to communicate 
at unit-rate via network coding. The connectivity between the 
Si — ti pairs is quantifled by means of a connectivity level 
vector, [fci k2 k:i] such that there exist ki edge-disjoint paths 
between Si and ti. In this work we attempt to classify networks 
based on the connectivity level. It can be observed that unit- 
rate transmission can be supported by routing if fc, > 3, for all 
i = 1, . . . , 3. In this work, we consider, connectivity level vectors 
such that mini=i,,.,,3 fci < 3. We present either a constructive 
linear network coding scheme or an instance of a network that 
cannot support the desired unit-rate requirement, for all such 
connectivity level vectors except the vector [12 4] (and its 
permutations). The benefits of our schemes extend to networks 
with higher and potentially different edge capacities. Specifically, 
our experimental results indicate that for networks where the 
different source-terminal paths have a significant overlap, our 
constructive unit-rate schemes can be packed along with routing 
to provide higher throughput as compared to a pure routing 
approach. 



I. Introduction 

In a network that supports multiple unicast, there are several 
source terminal pairs; each source wishes to communicate with 
its corresponding terminal. Multiple unicast connections form 
bulk of the traffic over both wired and wireless networks. 
Thus, network coding schemes that can help improve network 
throughput for multiple unicasts are of considerable interest. 
However, it is well recognized that the design of constructive 
network coding schemes for multiple unicasts is a hard prob- 
lem when compared with the case of multicast that is very well 
understood H], ||2l, ||3|. Specifically, it is known that there are 
instances of networks where linear (whether scalar or vector) 
network coding is insufficient |l4l|. 

The multiple unicast problem has been examined for both 
directed acyclic networks ll5l. Il6l. llTl. Il8l. Il9l. ifTOl. ifTTl. Tl2\. 
US, |[T4ll . ifTSll and undirected networks |fT6l| in previous work. 

The work of ||6l, provides an information theoretic charac- 
terization for directed acyclic networks. However, this bound 
is not computable. The work of fl\ proposes an outer bound 
for general directed networks. However, this bound is hard 
to evaluate even for small networks due to the large number 
of inequalities involved. There have been attempts to find 
constructive schemes leveraging network coding between pairs 
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of sources JSj, ||9]. Numerous works consider restricted cases 
such as unicast with two sessions ifTOl . ifTTI . lfT2ll . ifTSl and 
unicast with three sessions llT4l . ifTsl . ifTTl . We discuss the 
related work in detail in Section |ll] 

In this work we consider network coding for wired three- 
source, three-terminal directed acyclic networks with unit 
capacity edges. There are source-terminal pairs denoted si — 
ti,i = 1,...,3, such that the maximum flow from Si to 
ti is ki. Each source contains a unit-entropy message that 
needs to be communicated to the corresponding terminal. In 
this work, for a given connectivity level vector [ki k2 k^] 
we attempt to either design a constructive scheme based on 
linear network codes or demonstrate an instance of a network 
where supporting unit-rate transmission is impossible. Our 
achievability schemes use a combination of random linear 
network coding and appropriate precoding. Our solutions are 
based on either scalar or vector network codes that operate 
over at most two time units (i.e., two network uses). This 
is useful, as one can arrive at multiple unicast schemes for 
arbitrary rates by packing unit-rate structures for which our 
achievabiUty schemes apply. 
Main Contributions 

• For the case of three unicast sessions with unit rates, we 
identify certain feasible and infeasible connectivity levels 
[ki k2 k^]. For the feasible cases, we construct schemes 
based on linear network coding. For the infeasible cases, we 
provide counter-examples, i.e., instances of graphs where the 
multiple unicast cannot be supported under any (potentially 
nonlinear) network coding scheme. 

• We provide experimental results that demonstrate that our 
feasible schemes for unit-rate are useful for networks with 
higher capacity edges. Specifically, we demonstrate classes 
of networks with higher capacity edges, where packing our 
unit-rate schemes allows us to achieve transmission rates that 
are strictly greater than those achieved by pure routing. 

This paper is organized as follows. Section contains an 
overview of related work. In Section HIl] we introduce the 
network coding model and problem formulation. Section |IV] 
discusses infeasible instances, and Section [V] discusses our 
achievable schemes for 3-source, 3-terminal multiple unicast 
networks. Section |VT] presents simulation results on networks 
with higher capacity edges and Section IVIII concludes the 
paper with a discussion of future work. 

II. Background and Related Work 

It is well-recognized that network coding for multiple 
unicast is significantly harder than the network coding for 
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multicast. The work of 0] establishes an equivalence between 
network coded multicast and the problem of solving systems 
of linear equations. In the same paper, they also point out that 
for multiple unicast, one also needs to somehow decode the 
intended message in the presence of undesired interference. 
In general, it is intractable to find network code assignments 
that simultaneously allow the intended message to be decoded 
while mitigating the interference. In fact, it is known that linear 
codes are insufficient for the multiple unicast problem 1|4]. 

In this work our focus is exclusively on multiple unicast 
for directed acyclic networks (see ||T6l for the undirected 
case). Previous work in this domain includes the work of 
im that presents an information theoretic characterization of 
the capacity region. However, in practice this bound is not 
computable due to the lack of upper bounds on the cardinality 
of the alphabets of the random variables involved in the 
characterization. Moreover, even for small sized networks, 
the number of inequalities involved is very large. Similar 
issues exist with the outer bound of [7 |. There have been 
numerous works on achievable schemes for multiple unicast. 
The butterfly network with two unicast sessions is an instance 
where there is clear advantage to performing network coding 
over routing. Accordingly Traskov et al. [[8] proceed by 
packing butterfly networks for general multiple unicast. Ho et 
al. 191 propose an achievable region by using XOR coding 
coupled with back-pressure algorithms. Multiple unicast in 
the presence of link faults and errors, under certain restricted 
(though realistic) network topologies has been studied in 

MM- 

Further progress has been made in certain restricted classes 
of problems. For instance, an improved outer bound (GNS 
bound) over the network sharing outer bound for two-unicast is 
proposed in [12j. Price et al. ifTSl also propose an outer bound 
for two-unicast and demonstrate a network for which the outer 
bound is the exact capacity region. For two-unicast, Wang 
et al. ITOl (also see f20;| ) present a necessary and sufficient 
condition for unit-rate transmission and the work of llTTI and 
II2TI propose an achievable region for general rates. 

Some recent work deals with the case of three unicast 
sessions, which is also the focus of our work. The work of 
lfT4l and ifTsll use the technique of interference alignment 
(proposed in ll22l ) for multiple unicast. Roughly speaking 
they use random linear network coding and design appropriate 
precoding matrices at the source nodes that allow undesired 
interference at a terminal to be aligned. However, their ap- 
proach requires several algebraic conditions to be satisfied 
in the network. It does not appear that these conditions can 
be checked efficiently. There has been a deeper investigation 
of these conditions in iflTl . Our work is closest in spirit to 
these papers. Specifically, we also examine network coding 
for the three-unicast problem. However, the problem setting 
is somewhat different. Considering networks with unit ca- 
pacity edges and given the maximum-flow ki between each 
source (sj) - terminal (ti) pair we attempt to either design 
a network code that allows unit-rate communication between 
each source-terminal pair, or demonstrate an instance of a 
network where unit-rate communication is impossible. Our 
achievability schemes for unit rate are useful since they can be 



packed into networks with higher capacity edges. Furthermore, 
these schemes require vector network coding over at most two 
time units, unlike the work of 111 41 and 1151 . that require a 
significantly higher level of time-expansion. 

III. Preliminaries 

We represent the network as a directed acyclic graph G = 
{V,E). Each edge e £ E has unit capacity and can transmit 
one symbol from a finite field of size q per unit time (we are 
free to choose q large enough). If a given edge has higher 
capacity, it can be treated as multiple unit capacity edges. A 
directed edge e between nodes i and j is represented as 
so that head{e) = j and tail{e) = i. A path between two 
nodes i and j is a sequence of edges {ei, 62, ... , e^} such that 
tail{ei) = i,head{ek) = j and head{ei) = tail{ei+i),i = 
1, . . . , fc — 1. The network contains a set of n source nodes 
Si and n terminal nodes ti,i = 1, . . .n. Each source node Si 
observes a discrete integer-entropy source, that needs to be 
communicated to terminal ti. Without loss of generality, we 
assume that the source (terminal) nodes do not have incoming 
(outgoing) edges. If this is not the case one can always 
introduce an artificial source (terminal) node connected to the 
original source (terminal) node by an edge of sufficiently large 
capacity that has no incoming (outgoing) edges. 

We now discuss the network coding model under consider- 
ation in this paper For the sake of understanding the model, 
suppose for now that each source has unit-entropy, denoted 
by Xi (as will be evident, in the sequel we work with integer 
entropy sources). In scalar linear network coding, the signal 
on an edge is a linear combination of the signals on the 
incoming edges of i or the source signals at i (if « is a source). 
We shall only be concerned with networks that are directed 
acyclic and can therefore be treated as delay-free networks 1|T|. 
Let Ye- (such that tail{ei) = k and head{ei) = I) denote the 
signal on edge G E. Then, we have 

Ye, = -fi^'^^^j ^ ^ ■ • ■ ' Sn}, and 

{cj \head{ej)—k} 
n 

Ye- = cij.i^j where Oj ^ = if Xj is not observed at k. 

The coefficients a j ^ and /j ^ are from the operational field. 
Note that since the graph is directed acyclic, it is equivalently 
possible to express Yg. for an edge in terms of the sources 
Xj's. If Yg. = '^^^i Pei,kXk then we say that the global 
coding vector of edge is (3^. = [Pa.! ■ ■ ■ Pei,n]- We shall 
also occasionally use the term coding vector instead of global 
coding vector in this paper We say that a node i (or edge e^) 
is downstream of another node j (or edge e^) if there exists a 
path from j (or ej) to i (or e^). 

Vector linear network coding is a generalization of the scalar 
case, where we code across the source symbols in time, and the 
intermediate nodes can implement more powerful operations. 
Formally, suppose that the network is used over T time units. 
We treat this case as follows. Source node s; now observes 

(1) (T) 

a vector source [X!> ... Xl ]. Each edge in the original 
graph is replaced by T parallel edges. In this graph, suppose 
that a node j has a set of /3-inc incoming edges over which 
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it receives a certain number of symbols, and Pout outgoing 
edges. Under vector network coding, node j chooses a matrix 
of dimension f3out x Pine- Each row of this matrix corresponds 
to the local coding vector of an outgoing edge from j. 

Note that the general multiple unicast problem, where 
edges have different capacities and the sources have different 
entropies can be cast in the above framework by splitting 
higher capacity edges into parallel unit capacity edges and 
a higher entropy source into multiple, collocated unit-entropy 
sources. This is the approach taken below. 

An instance of the multiple unicast problem is specified by 
the graph G and the source terminal pairs Si—ti,i = 1, . . . , n, 
and is denoted < G, {si — >, where the integer 

rates Ri denote the entropy of the i*'' source. The s; — ti 
connections will be referred to as sessions that we need to 
support. 

Let the sources at Si be denoted as Xn, . . . , Xm.. The in- 
stance is said to have a scalar linear network coding solution if 
there exist a set of linear encoding coefficients for each node in 
V such that each terminal ti can recover Xn, . . . , Xm. using 
the received symbols at its input edges. Likewise, it is said to 
have a vector linear network coding solution with vector length 
T if the network employs vector linear network codes and each 
terminal U can recover [X^l^ . . . X^^], [xf^^ . . . xf^^]. 
If the instance has either a scalar or a vector network coding 
solution, we say that it is feasible. 

We will also be interested in examining the existence of a 
routing solution, wherever possible. In a routing solution, each 
edge carries a copy of one of the sources, i.e., each coding 
vector is such that at most one entry takes the value 1, all 
others are 0. Scalar (vector) routing solutions can be defined 
in a manner similar to scalar (vector) network codes. We now 
define some quantities that shall be used throughout the paper. 

Definition 1: Connectivity level. The connectivity level for 
source-terminal pair Si —ti is said to be /3 if the maximum flow 
between and ti in G is (3. The connectivity level of the set of 
connections si — ti, . . . , s„ — tn is the vector [max-flow(si — 
ti) max-flow(.S2 — ■ • • max-flow(s„ — in)]- 

In this work our aim is to characterize the feasibility of the 
multiple unicast problem based on the connectivity level of 
the Si — ti pairs. The questions that we seek to answer are 
of the following form - suppose that the connectivity level is 
[fci k2 ■ ■ ■ kn] - Does any instance always have a linear (scalar 
or vector) network coding solution? If not, is it possible to 
demonstrate a counter-example, i.e, an instance of a graph G 
and Si — tiS such that recovering the i-th source at ti for all 
i is impossible under linear (or nonlinear) strategies? 

We conclude this section by observing that a multiple 
unicast instance < G, {s — i^}", {1, 1, . . . , 1} > with connec- 
tivity level [nn ... n] is always feasible. Let Xi,i = 1, . . . ,n 
denote the i-th unit entropy source. We employ vector routing 
over n time units. Source Si observes [xj^^^ . . . 
symbols. Each edge e in the original graph G is replaced 
by 71 parallel edges, e^, e^, . . . , e". Let Ga represent the 
subgraph of this graph consisting of edges with superscript 
a. It is evident that max-flow(sQ — ta) = n over Ga- Thus, 
we transmit Xa\...,x!^'' over Ga using routing, for all 
a = 1, . . . , ri. It is clear that this strategy satisfies the demands 



of all the terminals. In general, though a network with the 
above connectivity level may not be able to support a scalar 
routing solution. 

IV. Network coding for three unicast sessions - 

INFEASIBLE INSTANCES 

It is clear based on the discussion above that for three 
unicast sessions if the connectivity level is [3 3 3], then a 
vector routing solution always exists. We investigate counter- 
examples for certain connectivity levels in this section. 

Lemma 2: There exist multiple unicast instances with three 
unicast sessions, < G, {si — {1, 1, 1} > such that the 

connectivity levels [2 2 2] and [1 1 3] are infeasible. 

Proof: The examples are shown in Figs. |l(a)| and 
|l(b)| In Fig. |l(a)[ the cut specified by the set of nodes 
{si, S2, S3, wi, U2} has a value of two, while it needs to support 
a sum rate of three. Similarly in Fig. |l(b)| the cut {si, S2, wi} 
has a value of one, but needs to support a rate of two. ■ 



s1 s2 s3 s1 s2 s3 




Fig. 1. (a) An example of [2 2 2] connectivity network witliout a network 
coding solution, (b) An example of [1 1 3] connectivity network without a 
network coding solution. 

While the cutset bound is useful in the above cases, there 
exist certain connectivity levels for which a cut set bound is 
not tight enough. We now present such an instance in Fig. |2] 
This instance was also presented in IfTTI . though the authors 
did not provide a formal proof of this fact. 

Lemma 3: There exists a multiple unicast instance, with 
two sessions < G, {si—ti, 52—^2}, {2, 1} > with connectivity 
level [2 3] that is infeasible. 

Proof: The graph instance is shown in Fig. |2] As- 
sume that in n time units, si observes two vector sources 
[Xj^^ . . . Xj"^] and [X^^^ . . . X^"^], S2 observes one vector 
source [X^'^ ... X;^"']. The sources are denoted as XV, 
X2 and X^ and are independent. The n symbols that are 
transmitted over edge are denoted by Fj". Suppose that 
the alphabet of Xi is X. Since the entropy rates for the three 
sources are the same, we assume H{Xi) = log \X\ = a. Also, 
since we are interested in the feasibility of the solution, we 
assume that the alphabet size of is also the same as X, 
and HiYij) < loglA"! = a by the capacity constraint of the 
edge. At terminal ti and t2, from Y"-^, Y^i^^ Yj" ™d ^22^ 
estimate X", X2 and X^. Let the estimate be denoted as 
Xi, X2 ^^'^ ^3- Suppose that there exist network codes and 
decoding functions such that P((Xf 7^ ^ 
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12 t1 

Fig. 2. An example of [2 3] connectivity network, rate {2, 1} cannot be 
supported. 



as n oo. For successful decoding at ti, using Fano's 
inequality, we have 



(1) 



where ne„ = 1 + 27iPe log(|;f|), Pe = P{{Xl\X^) + 
(Xf jXj"^)) and e„ ^> as n — )- oo. The topological structure 
of the network implies that X", X2 are functions of YI2 and 



Y^i- Hence, we have 



-"1^1 1-^2 -"^22^ — -"1^1 )-^2 1-^1 '^2 ' -*^12i -*^22i 

<if(Xr,X2"|Xi",X2") <ne„. 



(2) 



Since i7(Y]5, Fj^) !i 2ar7,, using eq. (|2]i and the independence 
of Xf, and X3, by Claim [19] (see Appendix), we have 



ne„ < i^(Xj|i7^,F2"2) < an, and 
i7(Yi"2, 5^221^3") > 2an - 27ie„. 



(3) 
(4) 



Next, we have 



E{Y-^,Y-2) H{XIX2XX22) " if(^3"l^2"l, >^2"2) 

':^i/(x^M^'l)-i?(X3"|r2'l,y2"2) 

< 207. - if(^3"l^2" , >T2, >"20, ^^12,^1", ^2 ) 

2an - i/(X3"|Kr2, F20, n"2, ^1", ^2 ) 



2an-i?(X3"|r22,^r,^2",yi"2) 



(5) 



2an - 7? (X3"|Kr2, IT2) + ^(^3 ; ^1", ^2" I ^^2 , ^"2 ) 

< 2an - i?(X^NlT2, ^Is) + (^r, ^2"I>T2, ^"2) 

(9) 

< 2a7i — ATI + ne„ + 7ie„ = an + 2?ie„, 

where (a) follows from the chain rule, (b) holds because y2'2 
is a function of X3' and 1^2"' (c) follows from the capacity 
constraints and the fact that conditioning reduces entropy, (d) 
follows as Y^i is a function of Yl^ and 1^20' (^) '^'^^ 
fact that 1^20 ^ function of X" and X^, (f) follows from 
the definition of mutual information, and (g) is a consequence 
of eq. (|2]) and eq. (O. The above inequalities indicate that 621 
and 622 need to carry the same information asymptotically for 
successful decoding at t\. 



(a.) 

> 2an — 2nen 

(b) 

> 3an — 2ne„ 

(<:) 

> 2an — 4ne„ 



From the network, we know that Yj^ is a function of Y{[ 
and X3 . This implies that 

H{Y-,Y-,Y-\X-) = H{Y-,Y-,Y-, X-\X-) 

> H{Y-,Y2'{,Y-\X-) (6) 

> H(r22,n"2l^3") > 2an - 2ne„, 
where (a) is due to eq. (|4]i. Finally, we have 

H{XS\Y{[,Y-,Y-) 

= HiY{{,Y-,Y-\X-) + H{X-) HiY-,Y-,Y-) 

an H{Y2%,Y-) H{Y{[\Y-,Y-) (7) 

a?i-2ne„-i/(yi1|r2"2,>Ti) 

an = an — 4?ie„, 

where (a) is due to eq. (|6]l, (b) is because of eq. ^ and (c) 
holds because of the capacity constraint on Y-[[. This implies 
that t2 cannot decode X^^ with an asymptotically vanishing 
probability of error. ■ 

Corollary 4: There exists a multiple unicast instance with 
three sessions, and connectivity level [2 3 2] that is infeasible. 

Proof: Consider the instance < G, {si-t'^jl, {1, 1, 1} >, 
where G is the graph in Fig. |2] The sources s[ and S3 
are collocated at si (in G), and the terminals t[ and tg are 
collocated at ti (in G). Likewise, the source s'2 and terminal 
^2 are located at S2 and t2 in G. The three sessions have 
connectivity level [2 3 2]. Based on the arguments in Lemma 
|3] there is no feasible solution for this instance. ■ 

The previous example can be generalized to an instance 
with two unicast sessions with connectivity level n^] that 
cannot support rates i?i = ni,i?2 = n-2 — 3ni/2 + 1 when 
77-2 > 3?7i/2 and ni > 1. 

Theorem 5: For a directed acyclic graph G with two s — t 
pairs, if the connectivity level for {si,ti) is ni, for (s2,t2) is 
712, where 712 > 3ni/2 and ni > 1, there exist instances that 
cannot support Ri = ni and R2 ^ n2 — 37ii/2 + 1. 

Proof: Provided in the supplementary documentation. ■ 

V. Network coding for three unicast sessions - 
Feasible Instances 

It is evident that there exist instances with connectivity 
level [2 2 3] (and component-wise lower) that are infeasible. 
Therefore, the possible instances that are potentially feasible 
are [1 3 3] and [1 2 4], or their permutations and connectivity 
levels that are greater than them. In the discussion below, we 
show that all the instances with the connectivity levels [13 3], 
[2 2 4] and [1 2 5] are feasible using linear network codes. 
Our work leaves out one specific connectivity level vector, 
namely [12 4] for which we have been unable to provide 
either a feasible network code or a network topology where 
communicating at unit rate is impossible. 

As pointed out by the work of H], under linear network 
coding, the case of multiple unicast requires (a) the transfer 
matrix for each source-terminal pair to have a rank that is high 
enough, and (b) the interference at each terminal to be zero. 
Under random linear network coding, it is possible to assert 
that the rank of any given transfer matrix from a source Si 
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to a terminal tj has w.h.p. a rank equal to the minimum cut 
between Si and tj; however, in general this is problematic for 
satisfying the zero-interference condition. 

Our strategies rely on a combination of graph-theoretic and 
algebraic methods. Specifically, starting with the connectivity 
level of the graph, we use graph theoretic ideas to argue that 
the transfer matrices of the different terminals have certain 
relationships. The identified relationships then allow us to 
assert that suitable precoding matrices that allow each terminal 
to be satisfied can be found. A combination of graph-theoretic 
and algebraic ideas were also used in the work of ||23l . 
where the problem of multicasting finite field sums over wired 
networks was considered. However, there are some crucial 
differences. Reference considered a multicast situation; 
thus, the issue of dealing with interference did not exist. As 
will be evident, a large part of the effort in the current work 
is to demonstrate that the terminals can decode their intended 
message in the presence of the interfering messages. 

We begin with the following definitions. 

Definition 6: Minimality. Consider a multiple unicast in- 
stance < G ^ {V,E),{s^ - ti}1,{l, 1} >, with 
connectivity level [fci k2 ... fc„]. The graph G is said to 
be minimal if the removal of any edge from E reduces the 
connectivity level. If G is minimal, we will also refer to the 
multiple unicast instance as minimal. 

Clearly, given a non-minimal instance G = (V, E), we can 
always remove the non-essential edges from it, to obtain the 
minimal graph Gmin- This does not affect connectivity. A 
network code for Gmin = {V,En-iin) can be converted into 
a network code for G by simply assigning the zero coding 
vector to the edges in E\Eaiin- 

Definition 7: Overlap edge. An edge e is said to be an 
overlap edge for paths Pi and Pj in G, if e G f ; fl Pj . 

Definition 8: Overlap segment. Consider a set of edges 
Eos = {ei, ■ ■ ■ , ei} C E that forms a path. This path is called 
an overlap segment for paths Pi and Pj if 

(i) V/c S {1, . . . , I}, Ck is an overlap edge for Pi and Pj, 

(ii) none of the incoming edges into tail(ei) are overlap edges 
for Pi and Pj, and 

(iii) none of the outgoing edges leaving head(eO are overlap 
edges for Pi and Pj. 

Our solution strategy is as follows. We first convert the original 
instance into another structured instance where each internal 
node has at most degree three (in-degree + out-degree). We 
then convert this new instance into a minimal one, and develop 
the network code assignment algorithm. This network code, 
can be converted into a network code for the original instance. 

Following 1241 we can efficiently construct a structured 
graph G = {V, E) in which each internal node v € V \s 
of total degree at most three with the following properties. 

(a) G is acyclic. 

(b) For every source (terminal) in G there is a corresponding 
source (terminal) in G. 

(c) For any two edge disjoint paths Pi and Pj for one unicast 
session in G, there exist two vertex disjoint paths in G 
for the corresponding session in G. 

(d) Any feasible network coding solution in G can be effi- 
ciently turned into a feasible network coding solution in 



G. 

In all the discussions below, we will assume that the graph 
G is structured. It is clear that this is w.l.o.g. based on the 
previous arguments. 

A. Code Assignment Procedure For Instances With Connec- 
tivity Level [1 3 3] 

We begin by showing some basic results for two-unicast. 
The three unicast result follows by applying vector network 
coding over two time units and using the two-unicast results. 

Lemma 9: A minimal multiple unicast instance < G, {si — 
ti,S2 — i2},{l,™} > with connectivity level [1 m + 1] is 
always feasible. 

Proof: Denote the path from si to ti as Pi = {Pn}, and 
the TO + 1 paths from S2 to t2 as V2 = {P21, ■ • • ,P2m+i}- 
The information that needs to be transmitted from si is Xi, 
and the information that needs to be transmitted from S2 is 
X21, . ■ . , X2m- We assume that Pu overlaps with all paths 
in V2. Otherwise, if Pn overlaps with n paths in V2 where 
< ri < TO + 1, w.l.o.g, assume they are P21, • ■ • , P2n- Then 
X2n, ■ ■ ■ , X2m Can be simply transmitted over the overlap free 
paths P2n+i, ■ ■ ■ , P2m+i, and the problem reduces to commu- 
nicating Xi and X21, X2n-i over Pn U P21 U • • • U P2„, 
which corresponds to the statement of the theorem with to 
replaced by n — 1. Hence, we focus on the case that Pn 
overlaps with all paths in V2- 

We assume that the local coding vectors for each edge are 
indeterminates for now. Source S2 uses a precoding matrix 
Q; the rows of 6 specify the coding vectors on the outgoing 
edges of 82- The choice of the local coding vectors and Q is 
discussed below. The transmitted symbol on the outgoing edge 
from S2 belonging to P2i is [On ■■■ 9i.,n][X2i ■■■ X2,nV 
where i = 1, ... , to + 1. Let 6j = [9ij ■ ■ ■ 9(m+i)]]'^ where 

j = 1,...,TO. 

As Pn overlaps with all paths on P2, there will be many 
overlap segments on Pn. Let Eosi denote the overlap segment 
that is closest to ti (under the topological order imposed by the 
directed acyclic nature of the graph) along Pn and suppose 
that it is on P21. A key observation is that Eosi is also the 
overlap segment on P21 that is closest to t2. Indeed if there 
is another overlap segment E'g,,i that is closer to t2 along 
P21, then it implies the existence of a cycle in the graph. Let 
the coding vectors at each intermediate node be specified by 
indeterminates for now. 

The overall transfer matrix from the pair of sources {si, S2} 
to ti can be expressed as 

[Mil I M12] = [ai I 7n ■•■ 7i(m+i)]- 

Similarly, the transfer matrix from the pair of sources {si, S2} 
to t2 can be expressed as 



[M21 I M22] = 

The received 

[M,i I M,2 



ai 
a2 

vector 



711 
721 

7(m+l)l • • 

at terminal 

Xi 



e[X: 



21 



■X 



2m 



7l(m+l) 
72(m+l) 

• 7(m+l)(m+l) 

ti is therefore 
The variables a's 
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and -fljS in the above matrices depend on the indeterminate 
local coding vectors and are therefore undetermined at this 
point. 

We emphasize that the first row of [M21 \ M22] is the same 
as [Mil I Mi2]. As there exists a single path between si 
and ti, it is clear that ai is not identically zero. Similarly, 
as there are to + 1 edge-disjoint paths between S2 to t2, we 
have that det(A/22) is not identically zero. Now suppose that 
we employ random linear network coding at all nodes. Using 
the Schwartz-Zippel lemma ll25l . this implies that ai ^ and 
dct(Af22) ^ w.h.p. We assume that ai and det(M22) 7^ 
in the discussion below. Next we select 6ij, i = 1, . . . , to+1, 
7 = 1, . . . , TO such that they satisfy the following equation. 





ai 





(8) 



where ai,...,am are non-zero values. Note that such 
[^1 ■ ■ ■ S.m] be chosen since Af22 is full-rank. 

Terminal ti can decode, since Mi2[0_i ■ ■ ■ 9„^] = [0 • • • 0] 
and ai ^ 0, and t2 can decode, since Xi is available at t2, 
and rank{M22[d_i ■ ■ ■ ^„J) = rn (from eq. Finally, we 
note that there are — 1 choices for each 9j. ■ 
We remark that the main issue in the above argument is to 
demonstrate that the choice of Q works simultaneously for 
both ti and t2- The observation that Eosi is overlap segment 
closest to ti and t2 along Pn and P21 respectively allows us 
to make this argument. 

The result for three unicast sessions with connectivity level 
[1 3 3] now follows by using vector linear network coding 
over two time units, as discussed below. 

Theorem 10: A multiple unicast instance with three ses- 
sions, < G, {si — ti}i, {1, 1, 1} > with connectivity level at 
least [1 3 3] is feasible. 

Proof: W.l.o.g. we assume that the connectivity level is 
exactly [1 3 3]. We use vector linear network coding over two 
time units. For facilitating the presentation we form a new 
graph G* where each edge e G E' is replaced by two parallel 
unit capacity edges and in G*. The messages at source 
node Si are denoted [Xn Xi2],i = 1, . . . , 3. Let the subgraph 
of G* induced by all edges with superscript i be denoted G*. 
In Gl, there exists a single si —ti path and three edge disjoint 
S2 — t2 paths. Therefore, we can transmit Xn from si to ti 
and [X21 X22] from S2 to t2 using the result of Lemma |9] 
Similarly, we use G2 to communicate X12 from si to ti and 
[X31 X32] from S3 to ^3. Thus, over two time units a rate of 
[1 1 1] can be supported. ■ 

B. Code Assignment Procedure For Instances With Connec- 
tivity Level [2 2 4] 

Our solution approach is similar in spirit to the discussion 
above. In particular, we first investigate a two-unicast scenario 
with connectivity level [2 4] and rate requirement {2, 1} and 
use that in conjunction with vector network coding to address 
the three-unicast with connectivity level [2 2 4]. 



Lemma 11: A minimal multiple unicast instance < 
G, {si — ii, S2 — t2}, {2, 1} > with connectivity level [2 4] 
is feasible. 

Proof: Let Vi = {-Pii,Pi2} denote two edge disjoint 
paths (also vertex disjoint due to the structured nature of G) 
from si to ti and V2 — {^21, -f22, -f23, ^24} denote the four 
vertex disjoint paths from S2 to 12- Let the source messages 
at si be denoted by Xi and X2, and the source message at S2 
by X3. We color the edges of the graph such that each edge 
on Pii is colored red, each edge on P12 is colored blue and 
each edge on a path in 7^2 is colored black. 

As the paths in Vi and V2 are vertex-disjoint, it is clear 
that a node with an in-degree of two is such that its outgoing 
edge has two colors (either (blue, black) or (red, black)). The 
path further downstream continues to have two colors until it 
reaches a node of out-degree two. 

Such an overlap segment with two colors will be referred to 
as a mixed color overlap segment. We shall also use the terms 
red or blue overlap segment to refer to segments with colors 
(red, black) and (blue, black) respectively. Note that by our 
naming convention path Pij is a path that enters terminal t^. 
Under the topological order in G we can identify the overlap 
segment on Pij that is closest to ti. In the discussion below 
this will be referred to as the last overlap segment with respect 
to path Pij. Two overlap segments £'0^1 and i?os2 are said 
to be neighboring with respect to Pij if there are no overlap 
segments between them along Pij . An example of neighboring 
overlap segments is shown in Fig. |3(a)| 

Claim 12: Consider two neighboring mixed color overlap 
segments £'0^1 and i?os2 with respect to path Pn G Vi. Then 
Eosi and i?os2 cannot lie on the same path P2j G V2- 
proof: W.l.o.g., assume that Eosi = {ei, . . . , Cfei } and Eos2 = 
{e'^, . . . , ejj^} are such that Cfcj is upstream of Now assume 
that both Eosi and Eos2 are on P2j. Note that head{eki) has 
two outgoing edges, one of which belongs to Pu and the 
other belongs to P2j (denoted by e*). We claim that e* can be 
removed while the connectivity level remains the same. This is 
because e* does not belong to Pu and P2k, Vfc j. Moreover, 
after the removal, P2j can be modified to the path specified 
as path{s2, head{eki )) — path{eki 1 ^'i) ~ path{head{e'i) , ^2) 
where path{eki, e'/,^) is along Pu. The new P2j is vertex 
disjoint of P2k, V/c ^ j, since Eosi and Eos2 are neighboring 
mixed color overlap segments along Pu which means that 
path{eki — e'l) is either purely blue or purely red. This 
contradicts the minimality of the graph. ■ 

Likewise, two neighboring mixed color overlap segments 
with respect to P2i, cannot lie on the same path Pij. 

To explain our coding scheme, we first denote the last red 
(blue) overlap segment with respect to Pu (P12) by Er (Eb). 
If there is no Er, then Xi can be transmitted along Pu. 
According to Lemma |9] X2 and X3 can be transmitted to 
ti and t2 respectively. A similar argument can be applied to 
the case when there is no Ei,. Hence, we assume that both Er 
and Eb exist. Based on their locations in G, we distinguish 
the following two cases. 

• Case 1: Er and Ef, are on different paths £ V2- 

W.l.o.g. we assume that Er and E^ are on paths P21 and P22- 

If there are no mixed color overlap segments on either P23 
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Si 




Fig. 3. (a) An instance of network wliere tliere are several pairs of 
neighboring overlap segments. Ei and E3 are neighboring overlap segments 
along P21, El and E2 sue neighboring overlap segments along P12. Ei and 
E4 are not overlap segments along any paths, (b) A network with connectivity 
level [2 4] and rate {2, 1}. The coloring of the different paths helps us to 
show that a linear network coding solution exists. 



or P24, X3 can be transmitted to ^2 through the overlap free 
path, and Xi,X2 can be routed to ti. Therefore, we focus on 
the case that there are mixed color overlap segments on both 
P23 and P24- Let Eosi denote the last mixed color overlap 
segments with respect to P2i, i = 1, . . . , 4 (see Fig. |3(b)| i. 
Our coding scheme is as follows. Symbol Xi is transmitted 
over the outgoing edge from si over Pu, i = 1,2; symbols 
OjXz are transmitted over the outgoing edges of S2 over 



1, ... ,4 respectively. The values of 0j G GF{q) 



will be chosen as part of the code assignment below. Let 
the coding vectors at each intermediate node be specified by 
indeterminates for now. The overall transfer matrix from the 
pair of sources {si, S2] to ti can be expressed as 
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M- 



12 



Ct2 



Pi 
P2 



111 712 
721 722 

vector 



7l3 7l4 
723 724 

at ti 



such that the received 
[Mil I Mi2][Xi X2 I 6*1X3 ... 6*4X3]'^'. Recall that 
Ej. and Ei, are the last mixed color segments with respect 
to Pii and P12. Thus, they carry the same information 
as the incoming edges of ti which implies that the row 
vectors of [Mn \ A/12] are the coding vectors on E,. and 
Eb respectively. Similarly, the transfer matrix from {si, §2} 
to the edge set {iJr, i?h, -Eoss, -£'034} can be expressed as 

Pi " 

P2 
P3 
Pi 

where we use the superscript 
transfer matrices are to the edge set {iJ^, -Eb, -Eoss, £'os4} 
and not to the terminal ^2- 

Note that the entries of the transfer matrices above are 
functions of the choice of the local coding vectors in the 
network which are indeterminate. Thus, at this point, the 
Mij and M'j-j matrices are also composed of indeterminates. 
As there exist two edge disjoint paths from si to {Er, E^}, 
the determinant of Mn is not identically zero. Similarly, 



[^^21 I M, 



22J 



Ct2 

Q3 
Q4 



711 
721 

731 
741 



712 
722 

732 
742 



713 
723 
733 
743 



714 
724 
734 
744 



to emphasize that these 



since the edges Er, Eh, Eqss and Eos4 lie on different paths 
in V2, there are four edge disjoint paths from S2 to the 
edge subset {Er, Eb, Eos3, Eosi}, and the determinant of 
M22 is not identically zero. This impUes that their product is 
not identically zero. Hence, by the Schwartz-Zippel lemma 
II25I . under random linear network coding there exists an 
assignment of local coding vectors so that rank{Mii) — 2 
and rank{M22) = 4. We assume that the local coding 
vectors are chosen from a large enough field GF{q) so 
that this is the case. For this choice of local coding vectors 
we propose a choice of ^ = [Oi 62 6*3 64]'^ such that the 
decoding is simultaneously successful at both ti and t2- 
Decoding at ti: As A/n is a square full-rank matrix, we 
only need to null the interference from S2- Accordingly, we 
choose 9_ from the null space of A/12, i-e., 

M12O = 0. (9) 

There are at least — 1 such non-zero choices for 9 as A/12 
is a 2 X 4 matrix. 

Decoding at t2: The primary issue is that one needs to 
demonstrate that the choice of 9 allows both terminals to 
simultaneously decode. Indeed, it may be possible that our 
choice of 9 along with a specific network topology may make 
it impossible to decode at t2- The key argument that this 
does not happen requires us to leverage certain topological 
properties of the overlap segments, that we present below. 
Claim 13. -In G either one or both of the following statements 
hold, (i) Er is the last overlap segment w.rt. ^21- (ii) Ei, is 
the last overlap segment w.rt. ^22- 

Proof: Assume that neither statement is true. This 
means that there is a blue overlap segment E[^ below Er 
along P21, and there is a red overlap segment E'r below Ei, 
along P22- Thus, E^ is upstream of Er and E[^ is upstream 
of El,. However, this means that edges /?'., Er, Ej^ and Ei, 
form a cycle, which is a contradiction. ■ 
In the discussion below, w.l.o.g., we assume that Er is the 
last overlap segment on P2i- The argument above allows 
us to identify edges Er, Eoss and Eosi that carry the same 
symbols as those entering t2 . We show below that the Xi and 
X2 components can be canceled by using the information on 
Eos3 and Eosi while retaining the X3 component. 



Let 7 represent the vector [7^1 7^2 7i3 7*4]^ 



1,...,4 



in the discussion below. Note that if [a^ P3] and [a^ jS^] are 
linearly independent, there exist 63 and 5i such that 

[ai ^1] = S^las P3] + Silai Pi], 

where 63 and ^4 are not both zero. Thus, t2 can recover 
[-7^ + (5373 + '^474] '^^-''^3 ■ Note that j^i = 0, by the 
constraint on 9_ above, thus we only need to pick 9 such 
that [(^37^ + S4'yJ^9_ ^ 0. To see that this can be done, 
we note that A/22 is full rank which implies that the matrix 
[7i 72 ((5373 + 547^)]"^ is full rank. Therefore, there exist at 
most q choices for 9 such that [7^ 7^ {S3l^+S4'y_J]'^9 = 0. 
Hence, there are at least q^ — q — 1 > non-zero choices 
for 9 that allow decoding at ii and t2 simultaneously. 
If [a^ P^] and [a4 (34] are dependent, decoding can be 
performed simply by working only with the received values 
over Eos3 and Eosi using a similar argument as above. 
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• Case 2: and Ef, are on the same path P2i. 
W.l.o.g., assume that Ef, is downstream of E,. along P2i- 
Then Ei, will be the last overlap segment w.rt. P2i- Let 
E'^ denote the blue overlap segment that is a neighbor of 
Eb w.r.t. Pi2- Note that cannot be on P21 according 
to Claim [12] If E[^ does not exist, it implies that there is 
only one blue overlap segment (namely, Eb) in the network. 
Therefore, there only exist red overlap segments on P23 and 
P24; using Lemma |9] Xi and Xj, can be transmitted to 
and t2 respectively over Pn U P23 U P24, and X2 can be 
routed along Pi 2 to ti. 

We now focus on the case when an E'j^ exists and assume 
(w.l.o.g.) that it is on P22. The main difference is that instead 
of using random coding over the entire graph, we modify 
our coding scheme such that random coding is performed 
over the graph except at E^ and all the edges downstream 
of Eh. At Pb, deterministic coding is performed such that 
Pb carries the same information as the incoming edge of it 
along P12. The information on E^ is further routed to all 
the downstream edges of P^. Note that by the deterministic 
coding, Pf, carries the same information as P^. 
Decoding at ti. Using the arguments developed in Case 1, it 
is clear that Xi and X2 can be decoded from the information 
on P^ and P^. The code assignment ensures that P5 and P^ 
carry the same information, thus ti is satisfied. 
Decoding at 12'- In Case 1, we showed that X^ can be 
decoded from the information on P^, Pos3 and Pos4- A 
similar argument can be made that X3 can be decoded from 
the information on P^, Pqss and Po,s4. Since P^ carries the 
same information as P^ and Ei, is the last overlap segment 
on P21, terminal t2 can decode X3 by the information on 
Eb, Pos3 and Pos4- 

■ 

By using the result of Lemma [TT] and the idea of vector 
network coding, we have the following theorem when the 
connectivity level is [2 2 4]. 

Theorem 14: A multiple unicast instance with three ses- 
sions, < G, {si — ti]\^ {1, 1, 1} > with connectivity level at 
least [2 2 4] is feasible. 

Proof: It can be seen that the line of argument used in 
the proof of Theorem [TO] namely using vector network coding 
over two time units and use the result of Lemma [TT] gives us 
the desired result. ■ 

C. Code Assignment Procedure For Instances With Connec- 
tivity Level [1 2 5] 

We now consider network code assignment for networks 
where the connectivity level is [1 2 5]. The code assignment 
in this case requires somewhat different techniques. In par- 
ticular, the idea of using a two-session unicast result along 
with vector network coding does not work unlike the cases 
considered previously. At the top level, we still use random 
network coding followed by appropriate precoding to align the 
interference seen by the terminals. However, as we shall see 
below, we will need to depart from a purely random linear 
code in the network in certain situations. 

As before, we consider a minimal structured graph G 
and let Xi be the source symbol at source node Si for 



i = 1,...,3 and Vi = {Pn} denote the path from si to 
ti, V2 = {^21, ^22} denote the edge disjoint paths from S2 
to t2, = {^31, -P32, ^33, ^34, ^^35} denote the edge disjoint 
paths from S3 to t^. 

Our scheme operates as follows: Xi is transmitted over 
the outgoing edge from si along Pn , £,1X2 are transmitted 
over the outgoing edges of S2 along P2i, i = 1,2, and 
OjXs are transmitted over the outgoing edges of S3 along 
P3j, J = 1, . . . , 5 where ^ = [6 6]^ and = [e, ... O^f 
are precoding vectors chosen from a finite field with size q. 

Let Ml = [Mji I Mi2 I Mis] denote the transfer matrix 
from {si, S2, S3} to terminal ti. Each Mij corresponds to the 
transformation from source Sj to terminal ti, i.e., the number 
of columns in Mij is 1, 2 and 5 for j ~ 1,2 and 3 respectively. 
Similarly, the number of rows in Mij is 1, 2 and 5 for i = 1,2 
and 3 respectively. 

In the discussion below we will need to refer to the 
individual entries of Mi and M2. Accordingly, we express 
these matrices explicitly as follows. 



Ml = [Mn I M12 I M13] = ai I I 7' 



= [ 


ai 1 / 


3i h 


71 72 73 74 75] , 






M2 - [ 


M21 


M22 


1 M23] = 




£^ 


iT ' 
1-2 






a I 




P'l2 


ill 


7(2 


7(3 


ii. 


ii, ' 




a2 






721 


722 


723 


7^4 


725 



where the entries of the matrices above are functions of 
indeterminate local coding vectors. The cut conditions imply 
that det(Mi,;) is not identically zero for i = 1,...,3, and 
furthermore that their product dct(i\jfii) dct(A/22) det(A/33) 
is not identically zero. 

Our solution proceeds as follows. We first identify a mini- 
mal structured subgraph G' of G with the following properties. 

(i) There exists a path P/^, from si to ti, 

(ii) vertex disjoint paths Pji and P22 from S2 to t2, 

(iii) path P{_^2 from si to t2 and 

(iv) path P2->i from S2 to ti. 

Again, G' is said to be minimal if the removal of any edge 
from it causes one of the above properties to fail. We note that 
it is possible that there do not exist any paths from si to t2 
or from S2 to ti in G. These situations are considered below. 

Our analysis depends on the following topological proper- 
ties of G'. 

Case 1: The graph G' is such that 

> there is no path from si to ^2 in G', i.e., P{_^2 = ^ (f^his 
happens only if there is no path from si to i2 in G), or 
« there is no path from S2 to ti in G', i.e., P2^i = (this 
happens only if there is no path from S2 to ti in G), or 
« there are paths Pj'_5.2 and Pli^i in G', and there are 
overlap segments between P[i and P21 U P22. 
Case 2: The graph G' is such that 

• there are paths P{^2 and P2^i in G', and P[i does not 
overlap with either Pji or P22. 
We emphasize that together Case 1 and Case 2 cover all the 
possible types of subgraphs for G'. Specifically, either Pj'^2 ^ 
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or Pj^j = 0. If both P^^^ and P^^^ exist in G", then either 
there are overlaps between P{^ and P21 UP22 o'" there are not. 

Theorem 15: A multiple unicast instance with three ses- 
sions, < G,{si — {1,1,1} >, with connectivity level 
[1 2 5] is feasible. 

6' 





(a) 



(b) 



Fig. 4. (a) Subgraph G' when Pjj overlap with Pji- (b) Subgraph G' when 
P^^ overlap with both Pjj^ and P22- 

Proof: We break up the proof into two parts based on 
type of the subgraph G' that we can find in G. 
Proof when there exists a subgraph G' that satisfies the 
conditions of Case 1 

We perform random linear coding over the graph G over a 
large enough field. In the discussion below, we will leverage 
the fact that multivariate polynomials that are not identically 
zero, evaluate to a non-zero value w.h.p. under a uniformly 
random choice of the variables. This is needed at several 
places. By using standard union bound techniques, we can 
claim that our strategy works w.h.p. 

In particular, in the discussion below, we assume that the 
matrices Ma, i ~ 1, . . . , 3 are full rank and design appropriate 
precoding vectors ^ and 9. 

Decoding at ti: For ti to decode Xi, we need to have ai ^ 
and the precoding constraints 



[/3i = 0, and 
[71 72 73 74 75]^ = 0. 



(10) 
(11) 



There are at least q — 1 non-zero vectors ^ and g'' — 1 non- 
zero vectors 9 that can be selected from the field of size q 
such that eq. ( fTOl i and eq. (fTTT i are satisfied. 
Decoding at t2'- 

We begin by noting that since rank{M22) — 2, M22C 7^ 0, 
as long as ^ ^ 0. Next, we argue according to the topological 
structure of G". The following possibilities can occur 
{i) There is no path from si to ^2 in G', i.e., P[^2 = ^- This 
implies that a'^ = a'2 = Q and in G, interference at t2 only 
exists from S3. Next, at least one component of A/22C will 
be non-zero, based on the argument above; w.l.o.g. assume 
that it is the first component. We choose 9_ to satisfy 



It is evident that there are at least q'^ — 1 non-zero choices 
of 9_ that satisfy the required constraints on 9_ (eqs. (fTTl i and 
(O). Hence t2 can decode. 

{a) There exists a path P[_^2fro'^ si to t2, i.e., P{^2 
This means that AI21 is not identically zero. Here, we first 
align the interference from S3 within the span of interference 
from si by selecting an appropriate 9. We have the following 
lemma. 

Lemma 16:\f A/21 7^ 0, there exist at least q^ — 1 choices 
for 9_ such that 

M239 = cM2i (13) 

where c is some constant. 

Proof: First, w.l.o.g., we assume a'2 ^ 0. Hence, there 
exists a full rank 2x2 upper triangular matrix U such that 

C/M21 = [0 a'2 



y'^ . Next, define 



[1 01 [/M- 



23 



-'T 



(14) 



and choose 9_ to satisfy 9_ — and set c = I2—I Upon 
inspection, it can be verified that this implies that l]M2-i9_ ~ 
cl]M2\. As I] is invertible, and there is only one linear 
constraint on 9_, we have the required conclusion. ■ 
Thus, under this choice of 9_, the interference from S3 is 
aligned within the span of the interference from s\ at t2- 
Let X_ = \X\ X2 -'^3]"'". The received signal at ^2 is 



[M21 M22? Af23^]^ = [A^21 M22S.] 



Xi + CX3 
X2 



(15) 



0. 



(12) 



The following claim concludes the decoding argument for 

t2. 

Claim 77.Tf A/21 is not identically zero, under random linear 
coding w.h.p., there exists a ^ such that ranfc[Af2i i\/22C] = 
2 and [/3i ^2]^ = 0. " 

Proof: We will show that there exists an assignment of 
local coding vectors such that det[A/2i A/22C] ^ 0. This will 
imply that w.h.p. under random linear coding, this property 
continues to hold. 

Suppose that there is no path from S2 to ti in G, i.e., P^^^ — 
and [/?! (32] is identically zero. This does not impose any 
constraint on ^. Next, Af22 is full rank w.h.p. Hence, we can 
choose a ^ such that required condition is satisfied. 
If there exists a path P2^i from S2 to ti in G', [/3i P2] 
is not identically zero. W.l.o.g., we assume that /3i is not 
identically zero. By Lemma |20] (see Appendix), proving 
that det[A/2i A/22^] 7^ 0, is equivalent to checking that 
the determinant in " (l22l l is not identically zero. Now we 
demonstrate that there exists a set of local coding vectors 
such that the determinant in (|22] | is non-zero. We consider 
the subgraph G' = Pi'iUP^iUP^2UPi^2UP2^i (identified 
above) - our choice of the coding vectors on all the other 
edges will be assigned to the zero vector As both Pj'^2 7^ ^ 
and P2'^i 7^ 0, we only consider the case where P[^ overlaps 
with P21 U P22. We distinguish the following cases. 

1) P[i overlaps with either P21 or P22. W.l.o.g., assume 
it is Pj]^. First note that when P^^ overlap with one of 
P21 and P22 in G', there is a path from si to ^2 and a 
path from S2 to ti in P{j U P21 U P22. Hence, G' can 
be completely represented by P{^ U P21 U P22. This is 
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shown in Fig. |4(a)| It is evident that we can choose 
coding coefficients such that 



/32] = [10], and 
,.1 [110 

[M21 M22]= Q Q ^ 



(16) 



By substituting them into eq. (l22l) . the determinant of 
[M21 M22C] is not zero. 
2) P{j^ overlaps with both Pji '^""^ -f22- Using a similar 
argument as above, G" can be completely represented 
by U P21 U P22 if Pii overlaps with both and 
P22. Note that there will be one overlap between P[i 
and each of P21 and P22. Otherwise, assume there are 
two overlaps between P[t^ and Pj]^, then some edges 
can be removed without contradicting the minimality 
of the graph G' . This is shown in Fig. |4(b)| Assume 
P[i overlap with P21 first. We can find a set of coding 
coefficients such that 



[M21 M22] 



[1 1] and 

1 1 
1 1 1 



(17) 



By substituting them into eq. ( |221 ). the determinant of 
[M21 M22^] is not zero. 

In both cases, therefore the required condition holds w.h.p. 

under random linear coding. ■ 

Terminal t2 can decode since it can solve the system of 

equations specified by in eq. dTSI ). 
Decoding at t^: At t^, we need to decode X3 in the presence 
of the interference from si and S2- The prior constraints on 
9, namely (fTTI) and (fTSl i for case (i), or dnj and ^ for case 
(ii) allow at least q'^ — 1 choices for it. As ^1/33 is full-rank, 
this implies that there are at least — 1 corresponding distinct 
M330 vectors. Next, for to decode X3, from Lemma |2T1 
we need to have 



M339 <f span{[M3i M32C]). 



(18) 



Since there are at most vectors in span{[M3i Af32^]), 
there are at least — — 1 > choices for 6_ such that all 
the required constraints on 9_ are satisfied. 
Proof when there exists a subgraph G' that satisfies the 
conditions of Case 2 

As before, our overall strategy will be to use random linear 
network coding, however in certain cases we will need to make 
modifications to the code assignment. We argue based on the 
properties of the minimal structured subgraph G". Recall that 
under Case 2, paths Px'^2 ^'^'^ ^2^1 exist and P[^ does not 
overlap with P21UP22. As the graph is structured, this implies 
that P[i, P21 and P22 are all vertex disjoint. 

Our first goal is to show that G' is topologically equivalent 
to one of the graphs shown in Figs. |5(a)[ |5(b)| and |5(c)| 
Towards this end, we color P[i U P21 U P22 black, the 
path P{^2 I'ed, and the path P2_^i blue. In this process, 
certain edges will get a set of colors (which are a subset of 
{red, blue, black}). Note that there cannot be any edge that 
has the color {blue, red}. To see this, assume otherwise: then 



one could find a new path from si to ti that overlaps Pi'_^2 
and P2^i and delete at least one edge from P^^, contradicting 
the minimality of G' . By similar arguments, P{^2 and P2^i 
cannot overlap on P21 U P22. Hence, paths P{^2 and P2^i 
can only overlap if they also overlap with P[i. 

Next, we identify certain special edges in G". As there is 
only one path going out of si, P[i and P{^2 will overlap. 
A similar argument shows that P[i and P2„j,i will overlap. 
Likewise, P{^2 and P2_i,i will overlap with P21 or P22. 
Consider, the overlap between P^^ and P{_^2- Using the 
minimality of G" it can be seen that there can be exactly 
one overlap segment between them; we identify the edge 
G P{i nPi'_^2 at the farthest distance from si, such that it has 
two outgoing edges belonging to exclusively Pj\ and P{^2' 
and call it ei. Similarly, we identify the edge G P{i f) P2^i 
that is closest to si, and call it 63. 

Next, consider the overlap between P{^2 ^^'^ ^21 ^ P22- 
Once again, by minimality it holds that there is exactly one 
contiguous overlap segment between P{^2 and P21 UP22, that 
can either be on P21 or P22. We identify 64 as the edge in 
Pi'^2 ^ (^21 U -P22) that is closest to si. In a similar manner, 
62 is identified as the edge P2^i H {P21 UP22) that is farthest 
away from S2. 

We now consider the possible orders of the edges ei, . . . , 64. 
As ei and ea belong to P{j, one of them has to be downstream 
of the other along P[i. Consider the following cases. 

• 63 is downstream of ei along P^^. If edges 62 and 64 
lie on the same path G {P211 P22}^ first note that 64 
has to be downstream of 62 (by minimality, otherwise the 
segment between ei and 63 along Pli can be removed); 
the graph G" is topographically equivalent to Fig. |5(a)| If 
62 and 64 lie on different paths G {P2i,P22}' the graph 
G" is topographically equivalent to Fig. |5(b)| 

• 61 is downstream of e^ along P[i, or 61 ~ 63. In this case 
62 and 64 have to lie on different paths G {P2i,P22}- 
To see this, assume they both lie on P^j^: if 64 is 
downstream of 62, the minimality of G" does not hold 
(segment between 62 and 64 along P2J can be removed), 
whereas if 62 is downstream of 64, the acyclicity of G" 
is contradicted. Therefore, the only possibility is that 62 
and 64 lie on different paths G {P2i,P22} and in this 
case G" is topographically equivalent to Fig. |5(c)| 

With the above arguments in place, it is clear that G" is 
topographically equivalent to one of the graphs in Fig. |5(a)| 
|5(H)lor|5(^ 

We now present our schemes for the different possibilities 
for G". For the class of G" that fall in Fig. 5(a)[ it suffices to 
use the approach in the proof of Theorem [15] Namely, we use 
random linear network coding in the network and precoding at 
sources S2 and S3. As in this case M21 ^ 0, one needs to argue 
that rank[M2i M22C] = 2. Following the line of argument 
used previously, we can do this by demonstrating a choice 
of local coding coefficients such that /32] = [1 0] and 

[A/21 -^^22] ^001' ^^w^^^'"' ^^''h an approach does 
not work when the subgraph G" belong to the class of graphs 
shown in Figs. |5(b)| and |5(c)] For instance, it is easy to observe 
that if we use random coding on Fig. |5(b)[ and precoding to 
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(a) 



(b) 



(c) 



Fig. 5. Possible subgraplis G' wlien does not overlap with either Pji or ^22- 



cancel the X2 component at ti, then t2 will receive a linear 
combination of Xi and X2 w.h.p., i.e., decoding X2 at t2 will 
fail. Accordingly, when G' looks like Fig. |5(b)| or |5(c)[ we 
require a different scheme that we now present. 



Modified random coding for cases in Fig 5(b) and Fig 5(c) 



It is clear that the strategy of random linear network coding 
and precoding at the sources fails since the determinant of 
the matrix [A/21 M22S,] is identically zero for the cases in 
Fig. |5(b)| and |5(c)| Thus, at the top level our approach is to 
modify the original graph G by removing certain edges and 
identifying a special node in G that is upstream of t2- The 
transfer matrix on the two incoming edges of this special node 
can be expressed as [M21 M22 M23] such that the determinant 
of [M21 is not identically zero. Thus, at this node it 

becomes possible to remove the effect of Xi via deterministic 
coding. Accordingly, our strategy is to first perform random 
linear coding at all nodes except the special node and those 
that are downstream of the special node. Following this, we 
perform deterministic coding at the special node to cancel 
the effect of Xi, and random linear coding downstream of it. 
Finally, we argue based on the precoding constraints that each 
terminal can decode its desired message. In the discussion 
below we outline each of the steps and the corresponding 
analysis in a systematic manner 

Recall that based on G' (which is a subgraph of G) we 
have identified paths P{i, P21, P22 that are all vertex disjoint, 
paths P{^2 ^2->i edges ei,...,e4. At the outset 
we demonstrate that certain structures in G, need not be 
considered. In particular, 

• if in G, there exists a path from si to ti that has an 
overlap with P2i^P22^ it is clear that an alternate minimal 
subgraph G" can be found that satisfies the conditions of 
Case 1. 

• In G, a path from si cannot have an overlap with 
path{e2 — e3). To see this note that G' is a subgraph of G; 
therefore if path(e2 — 63) exists in it, then it necessarily 
has to belong to a path P^i from S3 to t^. We emphasize 
that the entire path including 62 and 63 have to belong to 
P^i because by assumption all nodes in the graph have 
in-degree + out-degree at most 3. In a similar manner, 
the path from si that overlaps with path(e2 — 63) also 
needs to belong to path Psj-lf i = j, then it implies the 



existence of a path from si to ti that has an overlap with 
P21 U P22', however, this is explicitly ruled out by the 
discussion in the previous bullet. Thus, i ^ j; however, 
this is impossible since the paths P^i and P3j are edge 
disjoint. 

Accordingly, in the discussion below, we will assume that the 
above scenarios do not occur 

Graph modification procedure for original graph G: 

(i) Remove all edges downstream of 62 on P21 that have no 
overlap with a path from {Ji^iP-a. 

(ii) Identify an edge, denoted e first on P22' with the property 
that e first is the edge closest to S2 such that there exists 
a path{si — e first)- Note that e first exists due to the 
existence of path Pj'^2 G. 

(iii) Remove edges downstream of e first while maintaining 
the following properties - (a) there exists a path from 
e first — t2, and (b) max — flow{s^ — t^) = 5. Rename 
P22 to be path{s2 — e first — ^2)- It is important to note 
that after this procedure, removal of any edge downstream 
of e f irst would cause either property (a) or (b) to fail. 

(iv) Identify edge eiast G P22 such that it is the edge closest 
to t2 with the property that it has two incoming edges - 
e[ ^ P22 such that there exists path{si — e[) and e'2 G 
P22. Again e[ is guaranteed to exist as P{^2 exists in G. 

As a consequence of the modification procedure, there is 
no overlap between path{si — e[) and P22. To see this, 
assume otherwise, i.e., an overlap segment, denoted Eos exists 
between path {s I — e[) and P22. As e f irst is the edge closest to 
S2 such that there is a path between si and e first, it follows 
that Eos is downstream of e first along P22. However, this 
contradicts the property of the modified graph after Step (iii) 
in the modification procedure above. 

Next, note that path{e2 — e^) has to overlap with a path from 
Uf^]^P3i (as G is minimal) which means that the downstream 
neighboring edge of 62 along P21 cannot belong to any path 
in uf^j^Psi and will be removed in Step (i). Likewise the 
incoming edge of t2 along P21 will also be removed. At 
the end of the graph modification procedure, and using the 
observations made above, it is clear that we can identify a 
subgraph G of G that is topologically equivalent to either Fig. 
|6(i)lor|6(b)l 

Next, we perform random linear coding over the modified 
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graph except at edge eiast and all the edges downstream of 
eiast, and impose the precoding constraints /Ja]^ = and 
= 0. This ensures that ti is satisfied. Furthermore, note 
that there is no path from eiast to ti; therefore any code 
assignment on eiast and its downstream edges will not affect 
decoding at ti. 

For t2 to decode X2, we first demonstrate that by using 
deterministic coding for edge eiast, the Xi component can 
be canceled while the X2 component can be maintained on 
eiast- Note that e'^ and e'2 denote the incoming edges of 
eiast', we denote the transfer matrix to these two edges by 
[M21 M22 A/23]. 

Claim 18: For the network structures in Fig. |6(a)| and Fig. 
|6(b)[ the determinant of [M21 ^^22^] is not identically zero 
where ^ satisfies (32]^, = 0. 

Proof: Based on previous arguments, we have identified 
the subgraph G of G that is topologically equivalent to 
either Fig. |6(a)| or |6(b)| By Lemma |20] proving the claim is 
equivalent to showing that the determinant of eq. ( |22] | is not 
identically zero. Based on G it is evident that local coding 
vectors for the case of Fig. |6(a)| can be chosen such that 



P2 



[1 0], and 



1 
1 



[M2I M22]^ 

Similarly, for the case of Fig. |6(b)| they can be chosen as 

[/3i /32] = [10], and 



(19) 



[M21 M22] 



1 1 
1 



(20) 



Substituting the local coefficients into eq. (l22l i we have the 
required conclusion. ■ 
We now want to argue that t2 can be satisfied. Note that edge 
e'l must belong to a path from 7-*3, as the graph is minimal. 
Assume that there are k paths from that overlap with 
path{eiast — ^2); w.l.o.g. we assume that these are the paths 

^31, . • . , Psk- 

Next, we note that there can be at most one overlap between 
a path Psj and path{eiast — ^2). This is due to Step (iii) of 
the graph modification procedure, where we removed edges 
downstream of e first, (and hence eiast) such that the max — 
flow{s3 ~ t^) ~ 5 and there is path between e first ~ t2- If 
there are multiple overlaps between P^j and path{eiast — ^2), 
this would mean that there exists at least one edge that was not 
removed by Step (iii). As depicted in Fig. |6(c)[ we denote the 
overlap segments as Eqsi, ■ ■ ■ , Eosk, where Eosj is upstream 
of Eas(j+i) for j = 1, fc — 1 along ^22- ^1^° ^'^^^ '^^at the 
first edge of Eosi is eiast- 

The next step in the code assignment is to use deterministic 
local coding coefficients so that the transmitted symbol on 
eiast does not have an Xi component. Note that it is guar- 
anteed to have an X2 component by the Claim [18] above. 
Following this, we again use random linear coding on edges 
downstream of eiast- By the definition of eiast there is no 
edge G P22 downstream of eiast that is reachable from si. 
Thus all coding vectors along P22 downstream of eiast do not 



have an Xi component. Let the coding vector on the edge 
G Eosk closest to t2 be denoted by [0 | /3 | 7"^], where it is 
evident that /3 7^ w.h.p. We enforce the precoding constraint 
= 0. This satisfies t2- 
Finally, we discuss the decoding at t^. Consider the over- 
lap segments Eosi, ■ - ■ ,Eosk discussed above. Each of these 
overlap segments has an incoming edge that does not lie on 
P22 (the other has to be on ^22)- We denote these edges 



by e* 



= 1, 



, k, where we emphasize that e* 



Let the edges entering on paths 



noted Bf.^-^, 



fc+i)i 



F35 be de- 



,eg. Denote the transfer matrix on the edges 
el,..., el by [M31 | M32 | M33]. Note that with high 
probability it holds that rank^M^^) = 5, since the max-flow 
from S3 to these set of edges is 5. 

Next consider the rank of the coding vectors on edges 
{eiast, e'2, el, el, el}. For the sake of argument suppose that 
we remove the row of M33 corresponding to el and replace it 
with the corresponding row of eiast- As we used a determin- 
istic code assignment for edge eiast the rank of the updated 
M33 may drop to four, however it will be no less than four 
since it has four linearly independent row vectors. 

It can be seen that further random linear coding downstream 
of eiast will therefore be such that rank{M^'i) (recall that 
[M3i|Af32|Af33] is the transfer matrix to t^) is at least four 
w.h.p. Moreover, it can be seen that the information on Eosk 
also reaches t^, thus t3 can decode X2- Therefore at ^3 over 
the other four incoming edges we have a system of equations 
specified by the matrix [Af3i|Af33] (of dimension 4x6) with 
unknowns Xi and X3. Furthermore rank{M^'i) > 3. The 
constraints on 9 thus far dictate that there are g'^ — 1 non-zero 
choices for it. As shown in the appendix (cf. Lemma |22] | this 
implies that there are at least — 1 distinct values for 
For decoding X^ at t3, from Lemma [21] we need to have 



^33^ ^ spaniMsi). 



(21) 



As there are at most q vectors in the span of M31, it follows 
that there are at least q^ — q—1 > non-zero values of such 
that can be satisfied. ■ 

VI. Simulation Results 

Our feasibility results thus far have been for the case of 
unit-rate transmission over networks with unit-capacity edges. 
In this section, we present simulation results that demonstrate 
that these can also be used for networks with higher edge 
capacities, that can potentially support higher rates for the 
connections. The main idea is to pack multiple basic feasible 
solutions along with fractional routing solutions to achieve a 
higher throughput. The packing can be achieved by formulat- 
ing appropriate integer linear programs. We compared these 
results to the case of solutions that can be achieved via pure 
fractional routing. 

We applied our technique to several classes of networks. We 
did not see a benefit in the case of networks generated using 
random geometric graphs (this is consistent with previous 
results |]8]). We have found that our techniques are most pow- 
erful for networks where the paths between the various — ti 
pairs have significant overlap. Accordingly, we experimented 
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(a) 





(c) 



Fig. 6. Figures (a) and (b) denote possible subgraphs G obtained after the graph modification procedure for G. Figure (c) shows an example of the overlap 
between the red S3 — paths and P22. 




tit2 



Fig. 7. a) Level- 1 network, b) Level-2 network, c) Level-3 network, d) Level-4 network. 



with four classes of networks (shown in Fig. |7]i with varying 
levels of overlap between the different source-terminal pairs. 
The level- 1 network (Fig. |3a)) has the maximum overlap 
between the si — ti paths and the other paths; the overlap 
decreases with an increase in the level number of the network. 
The edge capacities in the networks were chosen randomly 
and independently with distributions as explained below. We 
conducted two sets of simulations. 

• Simulation 1. Let C denote the edge capacity. For the 
level- 1 network for the black edges we chose P{C = 
1) = 0.25, F(C = 2) = 0.4, F(C = 3) = 0.35; 
for the other edges, P(C = 1) = 0.15, P(C = 2) = 
0.6, P(C = 3) = 0.25. In the other networks we chose 
P{C = 1) = 0.15, P(C = 2) = 0.6, F(C = 3) = 0.25 for 
all the edges. Thus in this set of simulations, the maximum 
edge capacity is three. We generated 300 networks from 
these distributions and compared the performance of our 
schemes with pure fractional routing. The results shown in 
the first row of Table |I] indicate that the level- 1 network 
has the maximum number of instances where a difference 
in the throughput was observed; both [1 2 5] and [2 2 4] 
structures appear here. For the other networks, the [2 2 4] 
structure appeared most often. The second row of Table |I] 



records the average performance improvement when there 
was a difference between our scheme and routing; it varies 
between 4.9% to 5.59%. 

• Simulation 2. In this set of simulations we increased the 
average edge capacity. For the level- 1 network for the black 
edges we chose P{C = 5) = 0.25, P{C = 6) = 0.4, P{C ^ 
7) = 0.35; for the other edges, P{C = 5) = 0.15, P(C = 
6) = 0.6, P{C = 7) = 0.25. In the other networks we chose 
P{C ^5) ^ 0.15, P(C = 6) = 0.6, P(C = 7) = 0.25 for 
all the edges. Again, we generated 300 networks from these 
distributions and compared the performance of our schemes 
with pure fractional routing. The results shown in the third 
row of TableUindicate that in this higher capacity simulation, 
the number of networks where our schemes outperform pure 
routing is significantly higher For instance for the level-2 
and level-3 networks more than 50% of the networks showed 
an increase in the throughput using our methods. Another 
interesting point, is that one observes an increased gap for 
level-3 networks compared to the other cases. The fourth 
row of Table I] records the average performance improve- 
ment when there was a difference between our scheme and 
routing; it varies between 0.45% to 1.16%. 

We found that though there were instances of all the 
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TABLE I 

Proportions of networks with differences and performance 
improvement 



Network 


Level- 1 


Level-2 


Level-3 


Level-4 


Simulation I proportions 


5.33% 


2.33% 


1% 





Performance improvement 


5.59% 


5.06% 


4.90% 




Simulation 2 proportions 


47% 


53% 


80.67% 


2.33% 


Performance improvement 


1.16% 


1.31% 


1.36% 


0.45% 



Structures being packed by the ILP, the majority were [2 2 4] 
structures. For the level-4 network, since [2 2 4] structure 
cannot be packed effectively, there is a significant drop in the 
proportions of networks that exhibit a difference with respect 
to routing as compared to the level-3 and level-4 networks. 
There were significant advantages in our approach for the case 
of networks with higher edge capacities as in these networks 
the chance of packing our basic feasible structures is higher 
The average performance improvement obtained when there 
was a difference between our schemes and routing is not 
very high. We remark that the complexity of running the ILP 
increases with higher edge capacities and that was a limiting 
factor in our experiments; the performance improvement may 
be higher for large scale examples. Overall, our results indicate 
that there is a benefit to using our techniques even for networks 
with higher capacities, where the different source-terminal 
paths have a large overlap. 

VII. Conclusions and Future Work 

In this work we considered the three-source, three-terminal 
multiple unicast problem for directed acyclic networks with 
unit capacity edges. Our focus was on characterizing the 
feasibility of achieving unit-rate transmission for each session 
based on the knowledge of the connectivity level vector. For 
the infeasible instances we have demonstrated specific network 
topologies where communicating at unit-rate is impossible, 
while for the feasible instances we have designed constructive 
linear network coding schemes that satisfy the demands of 
each terminal. Our schemes are non-asymptotic and require 
vector network coding over at most two time units. Our work 
leaves out one specific connectivity level vector, namely [1 2 4] 
for which we have been unable to provide either a feasible 
network code or a network topology where communicating at 
unit rate is impossible. Our experimental results indicate that 
there are benefits to using our techniques even for networks 
where the edges have higher and potentially different capac- 
ities. Specifically, our basic feasible solutions can be packed 
along with routing to obtain a higher throughput. Future work 
would include a study of real-world networks where these 
techniques are most useful. 

Appendix 

Claim 19: For two independent random variables Xi and 
X2 with H{Xi) = a and H{X2) = b, if H{Xi\Y) < e„ 
where Y is another random variable with H(Y) < a, then 
b-en< H{X2\Y) < b, H{Y\X2) > a - 2e„. 



Proof: Since H{Xi) = a and H{Xi\Y) < e„, we have 
HiY) = H{Xi,Y)-HiXi\Y) > H{X^)-H{Xi\Y) > a-e„. 
Next H{Y) < a implies that 

H{Y\Xi) = H{Xi\Y) + H{Y) - H{Xi) < e„ + a - a = e„. 
As Xi and X2 are independent and H{X2) = b, we have 
b = H{X2)=H{X2\Xi) <H{X2\Xi,Y)+H{Y\Xi) 
< H{X2\Xi,Y) + e,, < H{X2\Y) + en <b + 

^^""^^ b~en<H{X2\Y) <b. 

Finally, we obtain 

H{Y\X2) = H{Y) - I{Y: X2) = H{Y) + H{X2\Y) - H{X2) 

> a — En + b — en ^ b = a — 2e„ 



Lemma 20: If /3i ^ 0, det{[M2i 
sented by 



^det 



"1 
a' 



^'^22^]) can be repre 



-hP'21 + m 



(22) 



where satisfies [/3i /32]^ = 0. 

Proof: Because ^ satisfies [/3i /32]£, = 0, we can have ^1 = 
— /32^2//3i- Note ^2 can be selected to be nonzero, regardless 
of the value of (32- By substituting ^1 into [A/21 M22£,], the 
determinant of [Af2i ^22^] becomes 



det 



M21 M22 



Ml 

I3i 

6 



I3i 



det 



■I3if3[2 
PiP'22 
(23) 



where £,2/^1 is nonzero. ■ 
Lemma 21: Consider a system of equations Z = HiXi + 
H2X2, where Xi is a vector of length h and X2 is a vector 
of length I2 and Z G span{[Hi i?2]i!l The matrix Hi has 
dimension zt x li, and rank li — a, where ^ < cr < l\- 
The matrix i/2 is full rank and has dimension zt x I2 
where zt > {li + h — c). Furthermore, the column spans 
of Hi and H2 intersect only in the all-zeros vectors, i.e. 
span{Hi) n span{H2) = {0}. Then there exists a unique 
solution for X2. 

Proof: Since Z G span{[Hi H2]), there exists Xi and 
X2 such that Z = HiXi + H2X2- Now assume there is 
another set of X[ and X2 such that Z ^ HiX[ + H2X2. 
Then we will have 



Hi{Xi^X[)=H2{X2-X'2). 



(24) 



Because span{Hi)rispan{H2) = {0}, both sides of eq.l24lare 
zero. Furthermore, since H2 is a full rank matrix, X2 = ^2- 
The solution of X2 is unique. ■ 
Lemma 22: There are at least — 1 distinct values for 
M^zS. when there are g'^ — 1 distinct values for 6_. 

Proof: Since M33 is a 4 x 5 matrix with rank at least 
3, we can find two vectors 7^ and 7^ such that the matrix 
^^33 = V^^zs, I 7i I "^2]^ rank{M^^) = 5. This implies 
that there are q"^ — 1 distinct values for M^^6_. Next note that 

^span{A) refers to the column span of A. 
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since rank{M^'i) > 4, 7^ can be selected as the coding vector 
for 9X3 on Eosk so that rank[AI^^ \ 7^]^ > 4. The precoding 
constraint implies that = 0. Hence, by removing 7^^ from 
Mgg^, there continue to be q'^ — 1 distinct vectors. If we further 
remove ^^9_ from M^^9_, there will be at least — 1 distinct 
values, i.e., there are — 1 distinct values for ■ 
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